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1 Introduction 



Local asymptotic normality (LAN) property is a fundamental concept in asymptotic 
statistics. Originated by Wald in [23] and developed by Le Cam in [14], it relies on the 
idea of approximating a sequence of statistical models by a family of Gaussian distribu- 
tions. Its consequence is that the initial model is approximately normal and thus inherits, 
in an asymptotic sense, the simple structure of normal models. Among the many appli- 
cations in mathematical statistics, local asymptotic normality is essential in asymptotic 
optimality theory and also explains the asymptotic normality of certain estimators such 
as the maximum likelihood estimator for instance. We refer for instance to [20] or in [22] 
for applications of LAN property. When dealing with inference on the parameter, LAN 
property will enable to assess optimality of any estimation procedure for this parameter 
which governs the behaviour of the random process. Hence LAN property is a powerful 
framework to understand probabilistic properties of a stochastic model. 

Many work has been done to prove LAN property for a large number of observation 
models such as i.i.d sequences of random variables parametrized by a parameter or Gaus- 
sian processes in [22] or more complicated random processes such as multifractal processes 
in [18], AR or ARMA based models in [8, 13] or extreme models in [6] for instance. 

We focus in this paper on statistical inference for empirical estimation of the parame- 
ters of spectral density of a certain class of Gaussian processes. We consider a stationary 
centered Gaussian process X„ whose spectral density is indexed by a parameter 6 and 
satisfies the condition 

fe{x) ~a;->o \x\~"^^'' Le{x) 

with Le a slowly varying function and a{9) G (— oo, 1). More precisely, we aim at proving 
Local Asymptotic Normality (LAN) for the model where we observe a sample of n ob- 
servations X„ = (Xi, . . . , Xn) by studying an asymptotic expansion of the log likelihood. 
For this, a precise control over the asymptotic behaviour of the some Toeplitz matrices 
linked with fe will be required. It relies on the results in [16]. 

In very particular, our assumptions (see section 3) are fulfilled by fractional Gaussian 
noises, which are defined as increments of fractional Brownian motions (see [12, 19]). 
From the LAN property fulfilled by fractional Gaussian noises, we deduce the LAN prop- 
erty when the observation model is a time-discretized fractional Brownian motion, which 
is not any more a stationary model. Moreover observation models of autoregressive frac- 
tionally integrated moving average processes (ARFIMA(p,d,q)), defined as a fractionally 
differenced ARMA processes in [9, 11], satisfy also our assumptions and are covered by 
our results. Note that, when d < —1, ARFIMA(p,d,q) are non-invertible processes (see 
[3]). 

The paper falls into the following parts. Section 2 is devoted to recall some basic 
properties of Toepliz matrices. Then Section 3 states the general LAN property for the 
considered processes. Section 4 is devoted to two examples that undergo the required 
assumptions (fractional Brownian noises and ARFIMA processes) and the LAN property 
for the non stationary model provided by the fractional Brownian motion. Most of the 
proofs are postponed to Section A. 
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2 Notations and some preliminary results on Toeplitz matrices 

For any integrable symmetric function / : [— 7r,7r] — M and any integer n G N\{0}, 
let us consider the real Toeplitz matrix 

Tn{f) =( r e^^''-^^yix)dx) . (1) 

Observe that if / is nonnegative, Tn{f) is a nonnegative matrix. Observe also that if 
/ 7^ on a non neglectible set, is positive and then invertible. 

Before stating some results on Toeplitz matrices, let us introduce some notations and 
recall some basic facts. First, if the nxn matrix A is nonnegative and Hermitian, hence the 
matrix A^^'^ defined as the solution oi A = (A^/^)^, exists and is a nonnegative Hermitian 
matrix. In addition, the spectral norm of the nxn matrix A is 

fx*A*AxY^'' 

II^L.n = sup — — , 

xeC" \ X X / 

where A* is the conjugate transpose of A. We recall that ||-||2„ is a multiplicative norm, 
that is for any nxn matrices A, B, 

\\m2,n < Il^ll2,nll^ll2,n- (2) 

Let us also recall that for any matrix A and any x G C", 

x*Ax<x*x\\A\\,^^^=\\A\\,Jxf, (3) 
with \\y\\ the Euclidean norm of ?/ G M" (see [10] for example). 

One of the main tools we use in this paper is the following lemma, which gives a 
bound for the spectral norm of some products of the form T„(/)~^''^T„((yf)^''^ under some 
assumptions for the functions / and g. This lemma, given in [16] (full version of [15]) , 
generalizes Lemma 5.3 in [4]. 

Lemma 2.1. Let f and g be nonnegative symmetric functions defined on [—71,71]. Assume 
that there exist some constants ci,C2 G (0, +00) and Pi, P2 & (—00, 1) such that for any 
X G [-7r,7r]\{0}, 

/(x) > ci|x| and g{x) < C2\x\ . (4) 

Then, there exists a constant K which only depends on (ci, C2, /32) such that for any 
integer n>l, 



T^Ur"'Tn{gf^ = T^gy^'T^fY 

2,n 



vl/2rp / j-\-l/2 



< 7^^max{(/32-/3i)/2,0)_ 



2,n 



Remark 2.2. In the previous lemma, observe that the assumption on / ensures that 
Tn{f) exists. Moreover, one can choose the constant K independently of (/3i,/32) and 
such that the conclusion holds for any (32 G [a, b]. 

In our framework, / depends on an unknown parameter 6 and is the spectral density 
of a centered Gaussian stationary sequence (Xn)^. This spectral density will be denoted 
fg and is assumed to be such that 

feix) ~^^o \x\~"^^^ Le{x) 
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with Lg a slowly varying function and a{9) G (—00, 1). Then next theorem deals with the 
uniform behavior in 6' as n —t- +00 of 



tr 



.£=1 



where denotes a spectral density or one of its derivatives which undergoes some tech- 
nical assumptions. If the true value Oq of the parameter is such that a(6'o) G (—1,1), 
this theorem is one of the main tools we use to obtain the LAN property. It allows 
us to consider a process (-^n)„ which admits antipersistence (q!(^o) < 0), short memory 
(q!(^o) = 0) or long memory {a{9o) G (0, 1)). This theorem is stated as Theorem 5 in [16] 
(full version of [15]). It generalizes Theorem 2 in [17], which is already a uniform version 
of Theorem l.a [7] and Theorem 5.1 in [4]. 

Theorem 2.3. Let 0* C be a compact set and p G N\{0}. For any I < i < p, 

consider fe:Q*x [— vr, vr] [0, 00] and gi : B* x [— vr, vr] — )■ M two symmetric functions 
with respect to their second variable. In the following, 

fe/ = feiO, ■) and ge/ = gi.{6, ■). 

Assume that the following conditions hold. 

1. For any 1 < i < p, for any 9 G 6*, fg/ and gg^e are differentiable on [— vr, 7r]\{0}. 
Moreover, for any 1 < i < p, fe, ^fe, ge o,nd ^g^ are continuous on 0* x 
[-7r,7r]\{0}. 

2. There exist two continuous functions a : O* — )■ (—1, 1) and /3 : 0* — i- (—00, 1) such 
that for any S > 0, for every {9, x) G 9* x [— tt, vr]\{0} and any I < i < p 



\x\ 



-a{e)+5 



<fi 



\x 



|-a(6»)-l-5 



-a{e)-5 



. , i G {1,2} some finite positive constants which only depend on 5 and B*. 



(c) and \gi{9,x)\ < c^^s.eAA''^'^^^'^ 
with c 

3. For any 9 G 6*, p{(3{9) - a{9)) < 1. 
Then, 

p 



lim sup 



1 



-tr 



n 



YliTnifg/)) ^T„,{gg,e 



.i=i 



1 

2^ 



^(/^/(a;)) ^geA^)d^ 



Remark 2.4. Observe that under Conditions 1. and 2., ^ = 1/ fi is continuous on 
B* X [— vr, 7r]\{0}, as assumed in Theorem 5 of [16]. 



If the true value 9q of the parameter is such that a{9Q) < — 1, the previous theorem 
can not be applied. However, the following theorem, which is a simple consequence 
of Lemma 8 in [16], provides a sufficient property to establish the LAN property. In 
particular, it allows us to study the LAN property for ARFIMA models whose order of 
differentiability are lower than 1/2, which includes some non invertible models. 
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Theorem 2.5. Let 6* = B{9Q,r) C be the closed Euclidean ball centered at Oq with 
radius r and let p G N\{0}. Consider / : G* x [— tt, tt] — > [0, oo] and for 1 < i < p, 
ge : G* X [— tt, tt] — t- M some symmetric functions in their second variable. In the following, 

fe = fiO, ■) and ge^t = ge{e, ■). 

Assume that the following conditions hold. 



1. The functions f and gi satisfy assumption 1 of Theorem 2.3. 

2. There exists a continuous function a : G* — t- (— oo, 1/2) such that for any 5 > 0, 
for every {9,x) G G* x [— 7r,7r]\{0} and any I < i < p, assertion 3(a), 3(b) of 
Theorem 2.3 are fulfilled (with fi = f), assertion 3(c) of Theorem 2.3 holds with 
(5 = a and 



< c. 



\x\ 



Then, for r small enough. 



lim sup 



-tr 



n 



ll{T^{fe)r'Ug6 



1 

2^ 



3 LAN property for a certain class of random processes 

Let Xn,n G N be a centered Gaussian stationary process with law Pg parametrized 
by = (6*1, ... , 9m) G G C M™' and associated with the 27r-periodic even spectral density 
fe. Then, under Pg, 

1 r 

E(X„X„+fe) = — / exp{ikx)fg{x)dx = Ck{fg). 

As usual, for 6 ^ rj, the set {x G [— 7r,7r], fg{x) = frjix)} is assumed to have positive 
Lebesgue measure. This assumption is not needed to obtain the LAN property but is a 
standard background assumption in statistics. Actually, if this condition is not fulfilled, 
the model is not identifiable, preventing any estimation issues. 

In practice, we observe the vector X„ = (Xi, . . . , with n G N\{0}, whose law is 
denoted by Pg. Under Pg, the covariance matrix of X„ is then the symmetric Toeplitz 
matrix ^ 

and the Fisher information of the model is the matrix 



1 / r d\oefe(x)a\ogfe(x) ^ 



The LAN property of the model is proved under the following assumption. 
Assumption 3.1. 
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(A.l) For any x G [— tt, 7r]\{0}, the function 6 i— t- fg{x) is three times continuously differ- 
entiable on O. In addition, for any < £ < 3 and 1 < ki, . . . , ki < m, the partial 
derivative 

"'•^'^<»;:^^»'^' 

is continuous on x [— tt, 7r]\{0}, continuously differentiable with respect to x on 
[— 7r,7r]\{0} and its partial derivative 



dxdOk, ...d9, 



-feix) 



is continuous on 6 x [— tt, 7r]\{0}. 



(A. 2) There exists a continuous function a : Q ^ (— oo, 1) such that for any 6 > 
and any compact set 0* C 9, the following conditions hold for every {9,x) G 
e*x [-7r,7r]\{0}. 



d 



< feix) < c, 



-a{e)-S 



(b) 



dx 



feix) 



< c. 



2.s,e* 



\x\ 



2,s,e* 
'a{e)-l-5 



(c) for any i G {1, 2, 3}, and any G {1, . . . , m} 



-feix) 



\x\ 



-a{e)-S 



dOk^ . . . d9k^ 

with c^^Q, some finite positive constants which only depend on 6 and G*. 

This assumption implies that 1/fg is well-defined on [— 7r,7r]\{0} and corresponds to 
Assumptions (Al), (A2) and (A4) in [15], except that we impose some smoothness prop- 
erty on the derivative of order three. This assumption, as noted in [15], is an extension 
and a reformulation of Dahlhaus's ones in [4, 5]. 

If for the true value 6*0 of the parameter, q;(^o) ^ ("l^l)) the LAN property (see 
Theorem 3.4) holds. Nevertheless, if a(6'o) < —1, the LAN property is established under 
the following additional assumption (which allows to apply Theorem 2.5). 

Assumption 3.2. Let 9* = 5(6*0, r) C 9. For any 6 > 0, for any i G {1,2,3} and 
k G {l,...,m}\ 



-feix) 



'a{e)-l~5 



with a and c o * given in Assumption 3.1. 



Under Assumption 3.1, the covariance matrix Tni^fe) is invertible (for each 9) and 
then, we compare the distribution of the model under Pg and Pr^ using the following 
proposition. 

Proposition 3.3. For any symmetric positive definite matrix T on (n G N\{0} ), Pr 
denotes the distribution of a centered Gaussian vector with covariance T. Then, for any 
covariance matrices Fi and F2, 



2 log 



dPr, 
dPr, 



(x,(F2^-Fr^)a;)+logdet(Fr^F2) 



where ( ■ ) denotes the usual Hermitian product in C". 
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The following theorem states LAN property for the observation model. 

Theorem 3.4 (LAN property). Let 6q be in the interior ofQ. Assume that Assumption 3.1 
is fulfilled. If a{6Q) < —1, assume also that Assumption 3.2 is fulfilled. Then under Pg^, 
for t eW^, we get 

log = Z^) - + i^Bo {t, n) 

where Zn does not depend on t and converges in distribution, under P^, to a centered 
Gaussian vector with covariance matrix I{6q), while ipgg{-,n) converges uniformly on each 
compact to Pg^-almost surely when n — )■ +oo. 

Proof. Let K C M™ be a compact set and consider r > such that 

e* = s(^o,r) c e 

where B{u,r) is the Euclidean closed ball of centered at u with radius r. Then, we 
can choose no, such that for any integer n > no and any t & K , 6q + 1/ y/n G 6*. 

Let us now consider n > uo and observe that for any t & K, Pg^ and Pg^_^^^^ are 
well-defined. Moreover, using Proposition 3.3, for any t ^ K, we get 



dP"- 

log '°+*/^ (x, 
dP- ^ 



Fn 00 + 



where x„ = (xi, . . . , x„) G M" and for 9 G B{9o, r) = 6*, 

= TT < x„, [T„(/eJ-^ - T„(/e)-Vn > +1 logdet[T„(/e)-iT„(/eJ]. 



By Assumption 3.1, Fn is three times continuously differentiable on B[6o,r). Hence, for 
any t E K, since Fn{Oo) = 0, 



Fn 00 + 



(t,VF„(0o)) t*V^Fnieo)t 



n 



2n 



. Ml 

< — — max sup 

6n'^/^ l<j,k,l<mQ^B{eo,r) 



d^Fn 



de.deM 



id) 



where V-Fn(6'o) is the gradient of Fn at ^o, V^-Fri(^o) its Hessian matrix at 9q and Mk = 
maxsgi^ 

Hence, setting Z„ = V FniOo) j y/n (which does not depend on t G i^T) and applying 
Equation (3), we get 



with 

sup \ipe^Xs,n)\ < 



Ml 



V'Fnieo) 



+ H 



n 



2,m 



Ml 

——r max sup 



d^Fn 



(0) 



The conclusion follows from the three following lemmas, whose proofs are postponed 
to the Appendix for sake of clearness. The first lemma deals with the behavior of Zn- 
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Lemma 3.5. Under P^, Z„ converges in distribution, as n ^ +00, to a centered Gaus- 
sian random vector whose covariance matrix is the Fisher information I{9q). 

Let us now state the asymptotic of V^F„(6'o). 
Lemma 3.6. Under P^^, V'^Fn{6Q)/n converges almost surely to —I{6q), as n ^ +00. 
Hence, 



n 

converges almost surely to as n ^ +00. 



2,m 



The next lemma deals with the behavior of the partial derivative of P„ of order three. 
Lemma 3.7. For r small enough, for any 1 < j, k,l < m, under PJ^ 

1 d'^Fn 
n^^^ B^^,r) d6jd6kd6i 

converges almost surely to 0. 

Conbining Lemmas 3.6 and 3.7, we get 

lim sup ra)! = P^-almost surely, 

which concludes the proof. □ 

4 Application to Fractional Gaussian noises and ARFIMA pro- 
cesses 

Here we consider two particular cases where the LAN property can be proved. 
Fractional Gaussian noises 

Let {BH{t))^^Q be a fractional Brownian motion (see [12, 19]) with Hurst index H G (0, 1). 
In other words, is a centered Gaussian random process whose covariance function is 
given by 

E{BH{t)BH{s)) = ^[\tr-2\t-sr + \sr] . (5) 

The parameter corresponds to the variance of Bh{1)- Let us now consider the centered 
stationary Gaussian sequence called the fractional Gaussian noise of index H, 

defined by 

for n > 1, Xn = BH{n) - BHin-1). 

The law of {Xn)n>i is parametrized by = (a^, H) G (0, +00) x (0, 1). According to [21], 
its spectral density /o-2,h is given by 

cm E |^ + 2fc.|^^+i ' xG[-vr,vr]\{0}, (6) 



where 



Ciia) 



Q;r(2a) sin(a7r) 
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Then, the model satisfies Assumption 3.1 with a{6) = 2H — 1. Since the range of a is 
(— 1, 1), the Assumption 3.2 is not needed in this example. 

Next proposition establishes the LAN property when the observation are modeled by 

Bn = {BHil),...,BH{n)} 

with Bh the fractional Brownian motion whose covariance function is given by (5). This 
model is not a stationary one but its log-likelihood can be linked to those of the fractional 
Gaussian noise 

X„ = {Bnil), Bh{2) - BhU), Bu^n) -Bn^n- 1)}, 

which fulfills Assumption 3.1. The law of B„ is parametrized by {a'^,H) G (0,+oo) x 
(0, 1) = 6 and denoted by Q^a jj- 

Proposition 4.1. Let I be the Fisher information of the fractional Gaussian noise X„, 
that is the Fisher information associated with the spectral density f^^^n defined by (6). 
Then, under Q^2 u , for t G and n large enough 

dQ^ 1 

log ^gf^^^^^ = (t, Z„) - U*I{al Ho)t + ^.g,^,(t, n) 

where Zn does not depend on t and converges in distribution, under Q^^2 fj^^y to a centered 

Gaussian vector with covariance matrix I{aQ,Ho), while ip^2 ff^^{-,n) converges uniformly 
on each compact to Q^^2 ^^yalmost surely when n — > +oo. 

Proof. Let Oq = (ctq, -f^o)- As previously, Pq denotes the law of X^,. Observe that 

where b„ = . . . , bn)' and x„ = 62 — • • • , &n — bn-i)' ■ Since under Q^2 „ , the law 
of x„ is Pg^, the conclusion follows from Theorem 3.4. □ 

ARFIMA processes 

ARFIMA processes have been introduced in [9, 11]. We also refer to [1] for general 
properties of ARFIMA (p, d, q). 

Let p, g G N. Then, a stationary ARFIMA process (^n)„ is parametrized hy 9 = 
(cr^, (i, $1, . . . , $p, \E'i, . . . , ^q) where d G (—00, 1) is the order of differentiability and the 
polynoms 

p q 
$(X) = 1 + ^ <l>jX^ and ^(X) = 1 + ^ ^^X^' 
i=i i=i 

have no zeros in the unit circle and no zeros in common. Then, its spectral density is 
given by 



feix) = aV - ir"" 



Then Assumptions 3.1 and 3.2 are fulfilled with a{6) = 2d. Theorem 3.4 also implies 
LAN property for this model. 



Compiled November 7, 2011 02:06 by pdfLiiTEX. 



Page 9. 



A Appendix 

A.l Proof of Lemma 3.5 

In this appendix, for £ G {1,2,3} and k G {l,...,m}^, dlfg denotes the partial 
derivative of (6*, x) h-?- fe{x) with respect to (6*^1, . . . , 6*^^, that is 

By definition of F„, for any 6 G B{6Q,r), and any integer 1 < /c < m, 
(9F 1 

-/(^) = 7r(x„,T„(/,)-X(9fc/,)T„(/,)-ix„)--tr(T„(9,/,)T„(/,)-i). (8) 

Let us fix M G and study the asymptotic behavior, under P^, of {u, VFn{9o)), that 
is by (8) of 

{u,VFM) = 7r(x„,T„(/,J-iT„((7,"jT„(/,J-ix„) - ^tr(T„((?,"jT„(/,J-i) 

with 

m 

9e = ^Ukdkfe- 

k=l 

To achieve this goal we use the following result on Gaussian random field. 

Lemma A.l. Assume that Y = (Yi, . . . , F„)' is a centered Gaussian random vector with 
covariance matrix T and consider A a real symmetric matrix of order n. Then, 

n 

where = stands for equality in distribution, {^j,n)i<j<^n ^'"^ eigenvalues of the real 
symmetric matrix F^/^AF^/^ and {Xj,n)jn ^'^^ i-i-d. random variables with distribution 
Moreover, 

n 

E((r,Ar)) = tr(AF) = tr(FA) and Var((r, AF)) = 2 ^ A|^„ = 2tr ((AF)^) . 

i=i 

Observe that under P^, x„ is a centered Gaussian random variable with covariance 
= i^Tnifoo)- Then, since Tn{feo)~^Tn{gQjTn{feo)~^ is a real symmetric matrix, under 

pn 
-^00' 

n 

where {Xj^n)j=i,.-,n are the eigenvalues of 

Bl = \T„{fe,r'"T^{gl)Tn{fe,)-'/'. 



Therefore, under P^ 
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where = iXj,n — ^)/V^ l£ j ^ n, n > 1) are i.i.d. centered random variables having 
unitary variance. To obtain the convergence of Z„, we use the following Lemma, which 
is an obvious corollary of Lindenberg theorem (see [2] for instance). 

Lemma A. 2. Let (Ci,n)n>i,i^Kn be a sequence of i.i.d centered random variables having 
unitary variance and let (f j,n)n>i,i^j^n be a triangular array of real numbers. Assume 
further that 

1. lim„^+oo SUPi<j<„ \Vj^n\ = 0, 

2. lim„^+o,E;^,i;|„ = r2>0. 

Then, as n ^ +oo, Y^^j=i '^j,n(,j,n converges in distribution to a centered Gaussian distri- 
bution with variance r^. 



We first check Condition 1 for the sequence Vj^n = V^n ^^^AJ„. Since Bg^ i 
Hermitian matrix whose eigenvalues are (•^j',n) i<j<„) spectral radius 



IS an 



Pn[U) 



sup I A", 

l<j<n 



is given by 



Pn[U) 



\x*Bnx\ 1 



sup 



- sup 

^ xeC"\{o} 



-1/2 



X\ 



Observe that for any y G C", and any integrable symmetric function h, 



y*Tn{h)y 



Vk 



k=l 



h{x)dx 



and therefore that 
Then, we get 



1 



Pn{u) < - sup 

^ xeC"\{o} 



y*T4h)y\ < y*Tn{\h\)y. 

x*TMeo)-'/'U\9l\)Tn{feo)-'^'x 



XX 



which can be written as 



(9) 



2,n 

since is a nonnegative symmetric function on [— 7r,7r]. 

By Assumption 3.1, the functions / = /e„ and g = [(^g^J satisfy Equation (4) with 
f3i = a(6'o) — S and (32 = o:{9q) + 6 (for any 6 > 0). Then, applying Lemma 2.1, for any 

5 > 0, we get 

Pn{u) < Ksn?^ 

where the finite positive constant does not depend on n. This implies that 

V^Pn{u) 



lim sup \vj^n\ 



n— >+oo 



i<i<"- 



lim 



0. 



n 
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This proves that Condition 1 of Lemma A. 2 is fulfilled. Let us now study the asymptotic of 



n 



n 

.?=i 



By definition of the A^,j, we get 



n 



2n 



2n 



Observe that if a{9o) > —1, /e.i = fe,2 = fe and gg^i = ge,2 = dg satisfy the assumptions 
of Theorem 2.3 with /3 = a on B* = B{6o,r) for r chosen small enough. Otherwise, 
for r small enough, fg and gg^i = gg^2 = dg satisfy the assumptions of Theorem 2.5 on 
6* = 5(6*0, r). Hence, applying one of these theorems, we get 



Hence, by Lemma A. 2, under P^, {u, Z„) converges in distribution, to a centered Gaussian 
random variable whose variance is u*I{6q)u. In other words, under P^, {u, Zn) converges 
in distribution to {u, G) with G a centered Gaussian random vector whose covariance 
matrix is I{6o). Since this holds for any u G M'", under P^, Zn converges in distribution 
to G. The proof of Lemma 3.5 is then complete. 

A. 2 Proof of Lemma 3.6 

Let us consider two integers I < j, k < m. We recall that dlfg is defined by (7) and 

set 




that is by definition of g^^ and I{9q), 



n 




Then, since 



dF„ 
ddk 



An,g{9)=Tn{ferTn{g). 
is given by (8), for any 9 G P(6'o,r), 



(10) 



{e) = Gn,m + Gn,2{e) + Gn,m 



where 



Gn,2{e) 



Gn,i{0) = n{^n,AnAdlJg)Tn{fg)-'^n) " "tr (9f,,/e)) , 

= -7r(x„, [An,g{djfg)An,g{dkfg) + An,g{dkfg)An^g{djfg)]Tn{fg)~'^Xn), 



and 



Gn,3{9) = ^tT{Tnmg)TM-'Tn{djfg)TM-'). 
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By Lemma A.l, under P^, Gn,i{Oo) is a centered square integrable random variable and 
Ep^;,Ki(^o)) = Varp. G.,i(0o) = Jtr (a„,,„ . 



By Assumption 3.1, if a{9o) > -1, fg^i = fe,2 = fe and gg^i = ge,2 = dlkfe satisfy 
the assumptions of Theorem 2.3 (up to a proper choice of a smaller r) with (5 = a. 
Moreover if a(6'o) < —1, by Assumptions 3.1 and 3.2, fe and 5^61,1 = ge,2 = dji^fe satisfy 
the assumptions of Theorem 2.5. Hence, by definition of A^ ^g, 

hm \Ep. {Gl,ieo))=0, 

n — s>+oo n a 

which implies that Gn^i{6o)/n converges P^-almost surely to 0. 

Moreover, again by Lemma A.l, under Pg^, Gn,2{0o)/n is a square integrable random 
variable with mean 

= ^Epn^(G'„^2(^o)) 

= -^tl'(^n,0o(f^j/6»o)^n,6»o(<9fc/6»o) + ^n.^o (f^fc/fo )^n,fo (f^j/eo)) 

= - ^tT{An,eo idjfe,)An,eo (^fe A,)) 

and variance 



a. 



^^tr{[An,eoidjfeo)An,0oidkf0o)] ) + ^tr(A„,,0o(5i/eo)^^n,eo(5fc/eo)^) • 



As previously, if a{9o) > —1 (respectively a{9o) < —1), we can apply Theorem 2.3 
(respectively Theorem 2.5). These theorems prove that 

hm mn = -— / „ , \r, dx = -2I{9o)kj and lim (j„ = 0. 



This implies that Gn,2{9o)/n converges P^-almost surely to — 2/(6'o)fcj- Since GnfliOo)/ 

1 d^K 



n 



'OJkj- 



Since this holds for any I < j, k < m, V'^FniOo) /n converges P^-almost surely to —I{9o), 
which concludes the proof of Lemma 3.6. 

A. 3 Proof of Lemma 3.7 

Let us focus on CJt", where 1 < k < m. We recall that An^ is defined in (10) and set 

k 

for the sake of simplicity, 

9lfe = dlJe and dlfe = dlj^Je 
where 9^^^ ^^^fe is given by (7). Then, for any 6 G B{9Q,r), we get 

-^{9) = + Hn,2{9) + i/„,3(^) + 
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where 

= Tl{-Kn,AnMfe)TnUB)-^^n). 

HnM = -37r(x„, [An^e{dlfe)A^^e{dufe) + A^^e{dkfe)AnMfo)\Tn{fB)-^Xn), 

HnM = QTT{^n,AnAdkfefTM)~'Xn) 

and 

HnAiO) = -tT{An,e{dkfe)'') + ltT{An,e{dkfe)Ar.,e{dlfe)) - |tr(A„,,(93/e)) 

Control of -ff^i,! 

Observe that since Tn{feo) is an Hermitian matrix, 

= 7r(T„(/eJ-i/2^„,T„(/eJi/2A„,,(93/,)T„(/e)-V). 

Therefore, by (3) 



2,n 



Hence by applying Equation (2), we get 



2 

2,n' 



Let us now consider e > 0. Then, by continuity of a, we can choose r sufficiently small 
so that 

«(^o) < Oi{e) < a(^o) 

for any 9 G B{6Q,r) = 0* C 0. Then, Assumption 3.1 implies that f = fe satisfies (4) 
with /?! = a{9o) — 2e and a constant ci which does not depend on 6* G -8(6*0, Note also 
that g = satisfies (4) with /32 = otiOo) + e > Pi. Then, by Lemma 2.1, we get 



G 5(^0, r), ||T„(/,)-VX(/.o)'/'||2,„ < ^^'^ 

where the finite constant K = -ft"eo,r,e does not depend on n and 6. 

Moreover, g = {dlfel is a nonnegative symmetric function which satisfies (4) with 
(32 = a(6'o) + 2e > f3i and a constant C2 which does not depend on G B{9o, r). Therefore 
by Lemma 2.1, 

Md G B{d^,r), \HnM\ < K'n''\\T„ifeor'^'xn\f 
where the finite constant K' = KL does not depend on n and 9. Therefore, 



■'■ I tr /o\\ ^ J^i 7e-l/2 [[-^"(^^o) ^ 

sup \Hn^\\p)\ < K n ' - 



Under P^, T„(/0f,)^^/^x„ is a centered Gaussian random vector with ^Id„ as covariance 
matrix. Then, by the strong law of large numbers, 

n n->+oo 71 
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Therefore, choosing e and r small enough, we get 



1 



j^3/2 



sup \Hn,i{9)\^^^- 



9eB(eo,r) 



n— >-+oo 



Control of Hn,2 and i?n,3 

Proceeding as for one check that for r small enough, for £ G {2, 3}, 



sup \HnI 



P" -a.s. 



n— >+oo 



> 0. 



:i2) 



Control of i?ri,4 

Assume first that a{9o) > —1. For 1 < ^ < 3, consider fg^g = fg and gg^i = dlfg. Then, 
by Assumptions 3.1, these functions satisfy assumptions of Theorem 2.3 on the compact 
set 0* = 5(6*0, r) (choosing r small enough) with P = a. Then, applying this theorem, 
we get that 

^ ^^(llTnifer'Mdlfe) 1 < +oo. 



sup sup — 



that is 



sup sup -\tT [An^g [dl fg)) \ < +00 

n ee-B(6»o,r-) ^ 



Assumption 3.1 also allows us to control the two other terms of H^^a by applying Theo- 
rem 2.3. This leads to ^ ^ 

sup— sup —\Hn^4,{0)\ < +00. (13) 
n n g^B{eo,r) 

If a{6o) < —1, applying Theorem 2.5 instead of Theorem 2.3, we see that Equa- 
tion (13) still holds. 



Control of ^ 

dot 

Equations (11), (12) and (13) leads to 



sup 

eeB{eo,r) 



j^3/2 



del 



PV- -a.s 
n— >-|-oo 



for r small enough. 



Computing an^ln^n aud then using the same arguments as for j = k = I, one obtains 



that 



sup 



dejdOkdei 



P" -a.s 
Op 

n— >+oo 



>0, 



which concludes the proof. 
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